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ABSTRACT 


This thesis is concerned with cyclic block codes which 
can be used for the detection and correction of errors in 
a transmitted message which are produced by various types 
of noise. Computer programs were developed and used for the 
actual encoding and decoding process. Advantages of using 
the computer as against using various types of dedicated 
hardware is demonstrated. Two different methods of decoding 
are presented: the minimum distance decoder and the syndrome 
method decoder. Pseudo random noise sequences were also gen- 
erated by computer program and used to simulate noise distur- 
bance of the encoded transmitted message. Codes of several 
rates and with varying degrees of. simulated channel noise 
were studied and compared with respect to the probability of 
error. It is shown how the methods developed in this thesis 
can materially help in choosing the 'best" code for a given 
noisy channel, consonant with other specified parameters fer 


message transmission. 





TABLE OF CONTENTS 


MPTNTRODUCTION ---~~------.-.-.___.__.............____ - 
MEE TGR @UN DE == =- =) ~~ 2-8 -u--_l 12 
Pe ORE omOr BLOCK CODES -==--s5------._.-.._. 14 
Pree oe) ane MOR meMeLiC CODES ==.----.-2. 7 
Oo (SC INIIG TEIN OLS NEG 5 aa a 19 
Per cmmceaoack shitt resister ~-~-----~-- 19 
Ce venmucGEapp ication of encoder ~----~--.-- 28 
D, CYCLIC DCO) == a= === aaa 32 
MPiunonimaucstance decoder -—--—-==-=]{—--—-.--~_- a2 
Pee Peratton Of Minimum distance decoder ----- 25 

3. Computer decoding using the syndrome 
method --------------------+-+--+-~+-+---+---+--+-+- 38 
4, Syndrome method decoder flow chart -------- 42 
ITI. CHANNEL NOISE ------------------------------------- LLU 
A. FLOW CHART DESCRIPTION OF NOISE PROGRAM ------- 6 
Rececr CODE PETERMINATION ------~~-~~------.---~-~--- 54 
 RSSULGS 2cotheee eee 57 
feel loCUSoLON AND CONCLUSIONS ------------~------------ 65 
APPENDIX A ------------------------------- nn nnn nnn 68 
APPENDIX Bo mmm nnn nnn (Gl 
APPENDIX © ----------------- nn nnn ncn renner 72 
APPENDIX D ~------------------- nnn nnn rrr 73 
APPENDIX E ----------~--------------------------7------ 25 
APPENDIX F -------------------------------4 5-00 nn noon a 
Pere ie G ==-—=—— wo -------- ++ --- ++ = $5 == --- + ---- == 82 





APPENDIX H 


LIST OF REFERENCES ------------------------------------ 


INITIAL DISTRIBUTION LIST ----------------------------- 





Il. 
eT, 


ito leor TABLES 


= 


INDEXING FACTOR K VS. CHANNEL }------------------ 5] 
P(e) VS. CHANNEL FOR THE CODE (15,4) ------------ 58 
P(e) VS. CHANNEL ® FOR THE CODE (15,8) ------------ 63 


P(e) VS. CHANNEL p FOR THE CODE (21,16) ----------- 





7 





aoe & 
; j st 





or 
9. 
10. 
il. 
12, 


13. 


14, 


15. 


HG 


Lye 


HG 


LIST OF FIGURES 


Gilet COMMUNICATION SYSTEM ------.-.__..__.....___ 
BINARY SYMMETRIC CHANNEL ----------_-_______..______ 


K-STACE ENCODER OF THE CODE (15,4) --------------_- 
CYCLE SET OF GENERATOR POLYNOMIAL G(x)=x/+x+1 ---- 


K-STAGE FEEDBACK SHIFT REGISTER FOR GENERATOR 
Penna CME NG y= ex +x 4] =---------------____ 


THE TWO CYCLE SETS OUT OF 17 OF THE GENERATOR 
POLYNOMIAL ONG eo ee acc ek ee ee 


Seem) COE R PLOW CHART --------~--~---_-_----..- 
time oltaNnCe DECODER --—-—-—--—-—----__--_--._..-..- 
Poe DISTANCE DECODER FLOW CHART --------------- 
SYNDROME METHOD DECODER FLOW CHART ---------------- 


SIMULATED NOISE (K=3, Ie =0.26613) VS. BINOMIAL 
DISTRIBUTION -------------------------------------- 


SIMULATED NOISE (K=5, ~=0.17092) VS. BINOMIAL 
Meee oe eos! ee 8  -----_- 


SIMULATED NOISE (K=6, SO LIE) VS. BINOMIAL 
DISTRIBUTION -------------------------------------- 


SMO LAnE mM NOnss (K=7, fF =0.12526) VS. BINOMIAL 
DSP TRI ON ose oo ee ee eee 


SIMULATED NOISE (K=9, ® =0.09797) VS. BINOMIAL 
DISTRIBUTION ------------------------- ei ee oS 


FLOW CHART OF THE SIMULATED NOISE PROGRAM --------- 
Pav iseecHANE igs FOR THE CODE (15,4) ----------~ 
P(e) VS. CHANNEL * FOR THE CODE (15,8) ----------- 


23 
24 


26 


27 
31 
34 
a7 
43 


46 


4? 


48 


510 
pe 


60 





20. 
el. 


P(e) VS. CHANNEL \* FOR THE CODE (21,16) 


RATE VS. FOR ANY P(e) ---------------- 





I. INTRODUCTION 





After the appearance of Shannon's classic papers in 1948 
and 1949, a great deal of research has been devoted to the 
problem of designing efficient schemes by which information 
can be coded for reliable transmission across channels which 
are corrupted by noise. The channel is described statisti- 
cally by giving a probability distribution over the set of 
all possible outputs for each permissible input. 

In Shannon's model, a randomly generated message produced 
by a source of information is 'encoded,' that is each possible 
message that the source can produce is associated with a 
Signal belonging to a specific set. It is the encoded message 
which is actually transmitted. When the transmitted encoded 
message is received, a ‘decoding’ operation is performed, that 
is, a decision is made as to the identity of the particular 
Signal transmitted. The main objective is to increase the 
elements of any set to be transmitted, and at the same time 
decrease the probability of error at the output of the decoder. 
How well one can do these things depends essentially on the 
properties of the channel. 

The establishment of digital technology provided a power- 
mal way of utilization in satellite communication, data trans- 
fer between computers and in military applications. 

Encoding and decoding operations were done by a mini- 


computer (DEC PDP - 11/40), channel noise was simulated by 


LO 





a computer program. The results were obtained from the 
computer program close to actual world binomial distribution. 
The codes investigated were members of a type known as cyclic 


codes. 


lac 





II. BACKGROUND 


In a communication channel, noise and disturbances modify- 
ing the signal create errors, a simple way to reduce UIC Clare tata 
at the receiver due to errors is to Simply transmit the message 
two or more times, a much more efficient way of providing means 
for detection and correction of errors involves the use of 
error correcting codes (controlled redundancy). 

Controlled redundancy or error correction coding is commonly 
divided into two main groups: (1) block codes (2) convolutional 
codes. Convolutional codes are decoded by a statistical pro- 
memrenave LO it's continuous (bit by bit) nature. On the 
other hand to decode the block codes, a whole word (block) has 
to be received. 

A block diagram of a digital communication system is 
shown in Figure 1. The information source provides a message 
or sequence of messages to be communicated to the receiving 
terminal. Message may be of various types (1) sequence of 
letters as in a telegraph or teletype system (2) an analog 
time function as in radio or telephone, (3) a function of time 
and two space coordinates as in black and white television, 

(4) several furictions of several variables as in color 
television, etc. Since the purpose of the source encoder 

is to present the information source output by a sequence of 
binary digits, one of the major questions of concern is to 


determine how many binary digits per unit time are required 


12 
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to represent the output of any given source. The error cor- 
meulon encoder used in this thesis is a cyclic encoder which 
is a type of block encoding system. Channel is merely a 
medium used to transmit the signal from ey rene to receiver. 
It may be a pair of wires, a coaxial cable, free space, a beam 
@fetight, etc. In any kind of channel the signal may be per- 
turbed by noise. The channel modeled in this thesis is a 
binary symmetric channel, which is shown in Figure 2. The 
error correction decoder performs the inverse operation of 
that done by the channel encoder, and in addition corrects 

the errors altering the message to the extend of that the 
errors can be corrected. The source decoder does the inverse 
operation of the source encoder, changing the data to the 
original signal. Destination is the person or thing for whom 


the message is intended. 


A. PRINCIPALS OF BLOCK CODES 

As pointed out earlier, coding and decoding systems are 
implemented by with the aid of minicomputer (DEC PDP - 11/40). 
Only binary codes were considered. 


Notations used in this thesis: 


k = Number of information bits 

m = Number of check bits 

n - Total word length in bits (n=mtk) 

e — Maximum number of errors can be corrected in 
one word 

R = Data rate (R=k/m) 

ies = Binary symmetric channel (BSC) parameter 
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Figure 2. Binary Symmetric Channel 
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X = source encoder output 


W = Error correction encoder output (code word) 
[T = Characteristic matrix of the code 

G(X) = Generator polynomial 

H(X) = Check polynomial 

d = Hamming distance between code words 

Z, | = Noise (as a word) 


In order to correct e-tuple or less errors in one word, 
there are two inequalities to be satisfied. 


a. Hammings lower bound inequality 


ok < 2" 


& () 


Yn 


22 2, (1) 


Hammings lower bound inequality is necessary but not sufficient 


or equivalently 


Pem@meconstructlibility on an e-tuple error correction code. 


b. Varsharmov - Gilbert - Sacks condition (upper bound} 


> 2) 


iis condition 1s sufficient but not necessary. 


These two bound's box in the number of check digits, m , 


required for a block code, where each word consists of n 
aeeits . 
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The code rate is the ratio of the message digits per word 
k , divided by n, since k equals n-m, it is obvious that 
increasing the number of check digits decreases the data 
feeoe, On the other hand increasing the number of check digits 
decreases the number of uncorrectible errors, therefore for a 
given signal to noise power ratio to desire to keep the data 
mipemhich, it is im conflict with the desire to minimize 
errors. One is than faced to with the task of making an 


engineering compromise. 


Eee DESCRIPTION OF CYCLIC CODES 

In this thesis a special class of block codes known as 
cyclic codes are described. This kind of codes have two special 
advantages over ordinary block codes: 

(1) Encoding operation is easy to instrument 

(2) A large amount of mathematical structure in the code 

makes it possible to find various simple decoding 
algorithms. 

Let K=(X5sXo1Xqs yonose na pegyy be an arbitrary sequence of 
information digits with each x.,1gick an element of a 
Galois field (GF 2) (which 1s 0 or iD omen, )-code 4s 4 
code in which the code words W= (Wy Wo rWareeee eee eWy) corres- 


ponding to each W is a sequence of n>k letters, generated 


by the rule 


oe 


fa 
iH 
fe 


i? 





Where the elements eer are arbitrary chosen elements of 
GF(2) the additions and multiplication are operations in 
GF( 2) 

A set containing at least two members that is closed 
under two operations (called ‘addition' and ‘multiplication’ ) 
is called a field. Roughly speaking, a field is a set in 
feet We can do addition, subtraction, multiplication, and 
division without leaving the set. The field I of matric 
polynomials p(I) of degree <i -lhas 2% elements; I is 
called the Galois field of order a written as GF (2a) 


The type of block codes can be represented 


Moe LHW dL 


eee yn e + b,-3" 1 


if any right or left cyclic shifts of this word is another 
word, and any linear combinations of such code words is 
another code word, the code is called a cyclic code (name of 
the cyclic code comes from the cyclic Si tomonewormas. LO ceil 
another code word). 

In the binary case multiplication of any code word by 
positive powers of two (left cyclic shift) is another code 
word, conversely multiplication by negative powers of two 
(right cyclic shift) is also another code word (in modulo De 
Ceneration of any code word can be realized by a k-stage 


feedback shift register or m-stage feedback shift register. 
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C. CYCLIC ENCODING 


1. k-stage feedback shift megister (Figure 3) 


This type of encoder has binary storage cells POF, 
Fo ee. s Pog switches E981 18o1 6 + + By 4 ae g, = 1 
weewcorresponding switch is closed, if §; = 0 the switch is 
open, the device also includes a modulo 2 adder. The system 


is controlled by a clock pulse. At t= 0 the binary message 


wo >be encoded is put into cells of the register. At each 


clock pulse the contents of F; are shifted to F,_ 1 and the 
new number in F, | is 
aomemeneeie e292 7° 7 2 2 FSX 7 
where XQ XprXo0 6 6 6s Xp gy is the message word to be encoded 


and Xs is the contents of register cell F.. 

The operation of a feedback shift register can be 
described by a matrix equation. If Xs is the number stored . 
in F. before the clock pulse and wae x's ig the number stored 
in the same register after the clock pulse, the contents of 


the register cells after the first clock pulse becomes; 


8 
7 eal 


q 
XA 


+ X 
Seco Gol 1 eoeeeaeaeee Si. ek 


1 
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ime mactrix form; 


ke} =[E7[ 4 





where 
Xo (6) 116 a 9 ee O 
| x X T =]/0 010 20 
O20> 0 1>., O 
Xx EnS Bo + +s + 
eal! 0&152 Sk-] 
=a) 
input word ehaeacteristic matrix 


Any initial message put into the shift register cells F,,F 


0’ 
- ey Fy (unless all zeros) will repeat itself after n-1l 


ee 


mieek pulses. At this point (t = 0 or t = n) a new message 

to be encoded is put into shift register cells, at each clock 
pulse the contents of shift register cell Fo will be taken 

as a encoded word bit, as one can see, the first k bits 

out of the shift register will be the actual message bits 
(information bits). At t= n-l1 clock pulse the last encoded 
met will be out of the shift register cell Po: the last n-k 
is Out of the shift register cell Fo will be the check 
G@ireits. After (peg) clock pulse the contents of shift 


register cells repeat, n defines the code length and 1t ass 


called the period of the shift register. 
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The characteristic polynomial of the an) matrix (character- 


istic matrix) is defined by; 


k-l k-2 


Bix) = I" - I x| = xg x 
The generator polynomial of the code G(x), in general 9(x) 
7A G(x), which is characteristic polynomial @(x) is higher in 
degree than generator polynomial G(x). However if character- 
mooac Matrix [Tr ] is in the form of given above, characteristic 
polynomial @(x) is equal to generator polynomial G(x). Given 
Pmenaracteristic matrix [T] , G(x) can be used to define the 
code uniquely. Example 1: If characteristic polynomial is 
chosen as 


ly 


meee] x +x41 


which is G(X) =X gx x7 gs X41 
B3 = Eo = O switches are open, k-stage feedback shift register 
becomes as shown in Figure 4. 

At t=0 if the message 0001 put in shift registers 
the contents of shift registers will follow the period shown 
feericure 5. Since the period of the characteristic matrix 
or the characteristic polynomial is fifteen, G(X) = cexe] 
generates the code with four information digits (power of 
characteristic polynomial is four) and eleven check digits. 
The given characteristic polynomial has the period el = 25; 
therefore it is called the maximum period polynomial or irre- 


ducible polynomial. Since the period of generator polynomial 


is fifteen it divides the polynomial xtoe7 (in modulo 2). 


Ze 





TetwoufkTog OTTLST Aap OeTeY 





ees Oe OE 
wes 0 


. aux FO qepooug ed@4S-F 


sy7ndut 
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Numbers in the circles are the decimal representation 


of what is in the shift registers at t= ts 


Figure 5. Cycle seit of generator Polynomial 
Cie =e ret xt | 
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The check polynomial of the same code is defined by: 


15 
H(x) = AER eg thy Se yey Sex Fex ey 


G(X) 
Miescoetficients form a code word, namely 000100110101111. 
The code generated by the given polynomial is a (15,4) code. 
The code is cyclic, therefore any cyclic shift of the check 
polynomial is another code word and any linear combinations 
of code words is also another code word. Since the generator 
polynomial G(x) is irreducible, fifteen cyclic shifts of the 


check polynomial is a code word and the code alphabet has 


ot = 16 words (including the zero word). To represent the 


code alphabet 15 cyclic shifts of the coefficients of the check 
polynomial defines the all non zero alphabet letters. 


Example 2: Let the generator polynomial be chosen as 


6, 4 


Goan = (Cerca (face a = so ose se +x +1] 


The k-stage shift register becomes as shown in Figure 6. If 

at t= 0 the message 00000001 is put in shift register cells, 
the contents of the register will follow the period shown in 
Figure 7. The generator polynomial has the degree eight, 
therefore number of code words are 2° = 256 (including the 

zero word), and the period of the polynomial is 15. This 
polynomial (being a reducible polynomial) has (255/15) = 17 

non trivial cycle sets and one trivial zero cycle (the zero 
word). Since the period of the polynomial is 15 (the word 
length), G(x) divides xt 547 (in modulo 2) the check polynomial 


of the code is" 
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Trivial Cycle 


Numbers in the circles are the decimal representation 


of what is in the shift registers of t= 4 


snow /. Ine two cyele sets out of a io the generator 


polynomial G(x) = xP C4 Ot x oar 
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x54 1 
G(x) 


6,4 


H(x) = = xxx 4] 


Maeecoetticients form a code word, namely 000000011010001. 
Any cyclic shifts of this code word is another code word, 
but by simply shifting it one can get only fifteen different 
code words. The code alphabet has ph §) = 255 (excluding the 
zero word) words, the other code words can be obtained by 
Jinear combinations of the 15 cyclic shifted code words. 
Since the generator polynomial given in this example is 
reducible, there is more than one maximum cycle (actually all 
the cycles have the same cycle length of 15, excluding the 
zero trivial cycle). The code generated by this polynomial is 
a (15,8) code. In the case where the number of check digits 
less than the number of information digits, choosing the 
shift register based upon the number of check digits (m-stage 
feedback shift register/ Ref. 5 page 225/) will simplify the 
encoder design. 

2. Computer application of encoder: 

Since the whole encoding operations were done with the 
aid of a computer (DEC PDP - 11/40), this section describes 
how easy it is to implement encoding operations with a computer. 
Encoder program used in this thesis just incorporates a matrix 
multiplication of the message word by the generator matrix 
described below. 

The coefficients of the check polynomial H(x) is a code 


word and any cyclic shifts of this coefficients is another code 
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word. One can define the generator matrix as one whose rows 


meeecode words. Such a generator matrix is in the form of: 


0,k-l 0,k-2 eee O70) 

OOO Fy x-1) Max-2 «'° 1,0 
= 0 0 iL 0 es lal h eee h 

Gen = 2,k-1 %o2,x%-2 2,0 
0 O O O e a Ph 9) on oe | Ao 


Any source encoder output message when multiplied by this 
Matrix, gives the encoded word as a result. If the encoded 


word is defined by an m and the input message to the error 
9 


correction encoder is defined by a bedi, k aia x 


[ w] iijin Lda abhi 


This is the easy and fast way to encode the messages. 
By changing the rows of the generator matrix (Goa sa pas Ol 
a different code, the encoder will be changed to one for the 
different cyclic code. To change the rows of the generator 
matrix ah. a one has to define the coefficients of the check 
polynomial H(x) for the new code, this is easy to do for 


any given code. Example 3: Generator matrix of the code 


(15,4) 


e9 





Onno Ond 10 10 21 1 

Ie], = [02 9011L010111100 
Ome OO lO 1 O11 1 10 
jmommieo OO 10 12111 


Let [x], ,= [001 q 


After multiplication by the generator matrix, the encoded 
word becomes 

lw], ,=f001101011110001] 
this is the modulo 2 addition of last 2 rows of the generator 


matrix [ce], n' 


The encoder program described by the flow chart shown in 
Figure 8 performs the matrix multiplication of the message 
word by the generator matrix. The operations used in the 


flow chart involved the following notations: 


MOV = move 

CLR = clear 

ASL = arithmetically shift left 

BCC —miiraichmrn carry rs clear 

XOR = exclusive or 

SOB = substruct one and branch if the result is 
Mot equal to zero 

RO = register # 0 

R1 = register #1 etc. 

(RO) = contents of register # 0 

(w) = contents of address w 

HLT = halt 

(RO)+ = increment contents of register # 0 (RO) by two 
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MOV CRO) + to (a) 


MOV "k" to R4 


GioR 1 w" 


. 


Oe CR oye to R 


ASL (a) 





HLT 


Figure 8. Cyclic Encoder Flow Chart. 
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The message digits are stored in a block in the form of ASCII 
code . 

The starting address of information message to be encodes is in 
RO . 

The starting address of encoded word is in Rl. 

Mie number of information characters to be encoded is in Re. 
The starting address of rows of generator matrix is in address(g). 
k is the number of information message bits. 


Pee cYCLIC DECODER 
1. Minimum Distance Decoder 


The Hamming distance is defined by the minimum number 
of different digits between 2 code words. 
Example: The Hamming distance between the following 2 code 
words 

CeerontyOwO 11012 011121 

aero mioiewOrl OF 1 tf 1 0 0 


is 8. If any combinations of ( oe) or less erros occur in 





a received code word, the distance of this perturbed code 
word to the original transmitted word is less than the other 
original alphabet letters. For the code above if three or 
less errors occur in one word the distance of this noisy word 
to the actual transmitted word is three or less but the distance 
to the other code words is five or greater. 
Example: 
original transmitted woud mopoer 0 O 1.10 102 1 110 
error sequence meron o2o) O 1°90 0 0-0 0 10.0 


received word mor oro © -O 10 0-1 0°11 0 1 0 


SZ 





The distance (d; ) between this received word and some of the 


other words is as follows: 


Code alphabet: 000100110101111 COUCOANIOCLOUITIO™ “000000000000 000 
received word: 


000001001011010 d=? 3 d,=5 


Using the fixed properties of irreducible polynomial codes, 

if the received word is not in the alphabet set, the decoder 
takes the code word which has a distance to this received word 
which is equal to or less than d/2, as a decoded word. 


For the code given by the coefficients of the 


ix) = ee ey eT meuleowlanmims distance is 6. 
One expects any combinations of three or less errors will be 
decoded correctly. Due to Varsharmov - Gilbert-Sacks condition 
(upper bound) for the (15,4) code e = 4 does not satisfy ane 
maeadvality. In experiments it is found that out of 1365 
different combinations of 4 errors 926 four errors can be 
corrected. Minimum distance decoder for any irreducible 
polynomial can be constructed as shown in Figure 9. 
2. Operation of Minimum Distance Decoder 

Starting from time t = 0 the received word is fed bit 
by bit to the shift register A. Register C has the coefficients 
of the check polynomial H(x) in binary representation, regis- 
ter D contains all zeros. At time t = n-1 register A will 


have the whole word [wz | Lent Where [w |, a is the original 
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transmitted word eae is the noise due to the channel. After 
time +t = n-1 gate #1 opens and the contents of register A 
enters register B. Since register C contains the coefficients 
of the check pommel eqd@weverwecyclic shift#of this poly- 
nomial is another code word, the corresponding bits of register 
B and C are added (modulo 2). If the resulting number of 

ones after addition in modulo 2 is greater than d/2 (indicating 
the Hamming distance between registers B and C is greater than 
d/2), the contents of register C will be shifted right and 

the corresponding bits of registers B and C are added together 
again to check if the resulted number of ones are less than 

or equal to d/2. Note that as each clock pulse shifts register 
C a new digit of the next word to be decoded is shifted into 
Memaster A therefore after n shifts of register C, register 

A will contain the complete code word, thus the decoding process 
is continuous. If during any one of the checks between 
registers B and C, the resulting number of ones is equal to 

or less than d/2, gate #2 opens and contents of register C 

will be transferred to register D as a corrected word. How- 
ever, if for any of the n clock pulses noreof the additions 
result in d/2 or less number of ones, the cleared contents of 
register D (the zero word) will be taken as the corrected word. 
At t = n-1l register A has the next received word |w + 2) 4 on? 
gate #1 opens and contents of register A enters the register 

B, register D is cleared and another cycle begins. Asa 
property of cyclic codes if a received word has a distance 


less than d/2 to the original transmitted word (code alphabet) 
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it can not be simultaneously that closer to another code word 
of the code alpnabet. After one word is decoded, there is 

no need to continue the modulo 2 additions between registers 
B and © until the next received word has been completely 
shifted into register A. 

When a reducible polynomial is used for the generator 
Polynomial, such as G(x) = xe txt] = (xt xt 1) Reese sk) 
and with check polynomial H(x) = ee oe all the cyclic 
shifts of the coefficients of the check polynomial H(x) is 
not enough to represent all of the possible code alphabet 
letters. Since the given (15,8) code cited above has 2°_4 = 255 
possible words (excluding the zero word), and since all the 
periods of the generator polynomial have length 15 (except 
the zero trivial cycle) one needs (255/15)=17 register C's 
(as described in Figure 9). With the different code words 
belong to the different cycle sets shown in Figure 7. Because 
as a property of cyclic codes, one code can be defined as a 
linear combinations of others and because the rank of generator 
matrix Gen is 8, it can be shown the number of register C's 
can be reduced to 8, instead of 17. 

The flow chart shown in Figure 10 performs the modulo 2 
addition between registers C and B to check the distance 
between original word and the received word to see if the 
distance is equal to or less than d/2. When the condition 


is met the contents of R3 is taken as the decoded word. 
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MOV _"h" to _R 
MOMGROo. to (a 


XOR R & I 







is Hamming 


: ie 
Distance < d/2° > = 





ASL R 





MOV R3 to (R1)+ 


SOB R2 


Figure 10. Minimum distance decoder flow chart (tee 


irreducible polynomial). 
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The notation used for the minimum distance decoder is 


same used for the encoder flow chart. 


starting address of received word is in RO 

starting address of decoded information word is in Rl 
number of received messages is in R2 

parity check polynomial is in (h) 


number of word bits isn 


3. Computer decoding using the syndrome method 


Another decoding system is achieved by using a decod- 


table stored in the computer's memory. In computer appli- 


cation of encoder section, the generator matrix for any code 


is defined by: 


O20 08. . 0 h 


1,k-1l iai2o eo 1,0 
a. O O e e ® O No KH} No K-2 ® t ® No 9 
‘a. 
0000 .. Thyy Mg +s: a 


The 


check matrix of the same code can be represented as: 
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ie yoK2 1,0 
ee ei > * Ro 9 
Meiy = Ayo No 
me =| 2 0 0 
0 1 0 0 


0 0 O dl =f 


Matrix multiplication of any original code word by the check 


matrix will result ina hells i matrix 


lw hon EU ee ‘ [ls om 


However if any error present in the received code word the 


result will not be the [0], ,, matrix, 
[w ‘ Ae ee ~ lw], Ud n,m i ls ltl nm 
LON a om ~ Lz} a bul n,m Ls] 4, m 


The matrix Bi, m 1S called the syndrome. For every error 


pattern [z} 5 has a unique syndrome [Ss], * By simply 
listing the correctible error patterns and versus their 
syndromes in table stored in the computer, one can find the 


error pattern readily after the syndrome has been found by 
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matrix multiplication of received by check matrix. The error 
pattern when exclusive OR'ed with the received word yield to 


most probable transmitted word. 


}w + Zhan + [zla ny = [whan (modulo 2) 


Restated step by step: 

(1) List all of the possible syndromes [sl] 1m and 
error patterns eee Wore the vothner mame is *corrector') due 
to given syndrome 

(2) Multiply the received word by check matrix to 
obtain the syndrome. 

Gitron decoding list, get the corrector due to 
obtained syndrome 

(4) Add this corrector to the received word in 


order to correct the errors 


Example: The alphabet of code generated by polynomial 
_ yt 
COX) = KX +Xtl 


is given by the Lw] ” matrix (one cycle of register C) 


LO 








' 


ror Fr OO OF FFP OO Oo FF 
Sa OS Ee Oe OO eo erent ae 
Se eS Yo KH One COC So oF one 
Sa aes Oo F PaO Oro lo oe 
OCF Se Co YE YY Kr 6 Oo oe ae 
Soe ae SS SH © ae) eke ete we 
OO OF FH ORF RFP KrF RP OF HO Oo 
roo FOF OO FP OF OF Oo FH »-E 
Oro Fr OF OO FF OF OF Oo fF 
CO FO FF OF FP OF FPO KF Oo 
a Oo 0° O° FF FO - oo oH Eye 
eS eH Oo Oo CO OO 0 0 HY BFP Ee Ee eS 
Oe = a at OS OS Oe eo ee se ee 
ror OO Oo FF OO KF KH FH Oo fF 
Or OO FPF rFrRPOOrF KrF FO OO FH 





Se i Fe 


The last "m" columns of [wl s matrix gives the syndrome of 
? 


Serrecsponding corrector of first "k" columns (error pattern). 
Example: 


Error pattern ye Syndrome oi 
mero O0000000000 0 ORC Ond © 1 } 1 
mero OlO00000000 0 COSOPO Mame Orie Oo | t i 
moro o O00 0 0110000 Om Oma teoe lO er 1.) 1 
As one sees any additional errors in the check digits yield 
a corresponding digit changed in the syndrome, this property 
of syndromes make the decoding table easier and shorter. 
To make up the decoding table, first list the error patterns 
LZla on according to their weight using the ale Matrioe aia 


list the corresponding syndromes. Since one only needs to 


hy 





correct the errors in the information digits, it is enough to 
Mea tne first k digits of error pattern iz}, x to corres- 


ponding digits of received word. 


4, Syndrome method decoder flow chart (Figure 11) 


First syndromes and error patterns (correctors) assumed 
listed in memory. The program multiples the received word by 
check matrix ee and result is the syndrome US om matrix 
from this syndrome, listed error pattern are obtained and 


added to received word for correction (in modulo 2) 


The starting address of received word is in RO 
The starting address of decoded information words is in Rl 


The number of received message is in R2 


1 7 


The starting address of syndromes is in memory address "a 
The starting address of correctors is in memory address "b" 
The starting address of the rows of parity check matrix 
ee, tom memory address “h 


eas the number of code word bits. 


Additional notation used is given below 


JUS Jb test address 


BEQ branch if equal to 


COMP = compare two addresses 
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COMP (ad) & (R3) 





Mov (RO) to (ec 
MOV tt lala To R | 















TST (R3)+ 


ly a 


Vi ae 


MOV (R4 R 
rOR RS (d) 


te Jet 
(da 

© 

EO 
& 


sub | (d) 
BEQ 


Mov 'a to R3 









MOV "bd" RY 





1Ke 


Figure 11. Syndrome Method Decoder Flow Chart. 
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ITI. CHANNEL NOISE 


Channel noise simulation by the computer can be described 


in two parts, (1) generation of random numbers (2) generation 


of noise sequence. 
(1) Generation of random numbers 
Random numbers generated in this program were obtained 


by using the Lehmer congruential. method. 


Xt] = 2X, + Db (modulo To) 


betting a = 257, b= 3, the starting number x, is chosen as 


O 
a prime number and changed for each sequence, Ty = 2i6 (all 
in decimal). Therefore the period of the random number sec- 
uence is 26 | After the generation of the random numbers, 


every yh of them is taken as a selected random number, where 


K is called the indexing factor which we shall see, related 
to the channel in the binary symmetric channel (Figure 2). 
The selected random number is taken to specify the address of 
a random number field, and a marker ‘l' is put in to this 
address. 
(2) Generation of noise 

The markers put in the random number field were taken 
to designate the ones in a sequence of zeros and ones, the 
sequence has a one to one correspondence to the random number 
field. The resulting sequence is exclusive OR'ed with success- 


ive words of the encoded message, thereby simulating the 
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introduction of error bits. Word corresponding to carriage 
return was given noise immunity, but in the probability of 
error calculations, the number of carriage returns were sub- 
tracted from the number of inputs. 

Figures from 12 to 16 represent the actual and binomial 
distribution of errors due to the indexing factors K used. 

The />'s is taken as a probability of an error (or a1) and 

is calculated by counting the number of ones out of 153000 

Pies (in decimal). It is found that the simulated noise 
sequences more or less closely follow the binomial distribution 
except for K equal to powers of 2. It is helpful to point out 
Piet 10r any binary symmetric channel, is very closely related 
memsienal to noise ratio (S/N). 

The channel used in this thesis is a memoryless binary 
symmetric channel. Memoryless channel is the one which noise 
doesn't depend upon the previous-in time - value). Binary 
symmetric channel is the one which the probability of bit 
zero to change the bit one is equal to the probability of bit 
one to change the bit zero. Table I represents some indexing 


factors K versus binary symmetric channel P's. 


A. FLOW CHART DESCRIPTION OF NOISE PROGRAM (Figure 17) 

This program describes the generation of random numbers to 
put into random number field by the Lehmer congruential method. 
After this program one can combine the markers according to 
it's word length (code length). Additional notation used in 


Ties tlow chart: 
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Table I. 


Indexing a 
Factor (k) 
i. 
P| oazsen 
=a 
— 


pe | eae 














O. eke, 










imagexmine actor K Vc. 


oil 


Channel =) : 












MOV is) | to R 


MULT "a" by Xp 







ADD "b" to a-x 


* 
SOB R DEC OO eer a 
DEC "10000" 


DS? (R5)+4 


aS 5: Doe x =ax,t b | 
CLR Zero bit of *n 


Add (RO) to Xp 


ee tO ( ROTX, ) 





MOV "n" to R3 


ASR (RO)+ 


hioneem lye Eiow Chart of the Simulated Noise Program. 


Si 





MULT = multiply 

ADD = add 

DEC = decrement 

BEQ = branch if the result is equal to zero 


K is the indexing factor (defines je for binary symmetric 
channel 
n is the word length 


x is the starting prime number 


0 
The starting address of random number field is in RO 


The starting address of noise field is in R5 
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IV. BEST CODE DETERMINATION 





The noisy channel theorem / Ref. 1 /: Let a discrete 
channel have the capacity C bits/sec. and a discrete source 
Nas the entropy per second H. If H<C there exists a coding 
System such that the output of the source can be transmitted 
over the channel with an arbitrarily small frequency of errors. 
1m > Cc, it 1s possible to encode the source so that the 
equivocation is less than H-C+€where <« is arbitrarily small. 
There is no method of encoding which gives an equivocation less 
than H-C. The discrete source entropy for long messages 


consisting of discrete symbols is given by 


n 
H(x) = - = p, log p, 
i=1 


where p; LmCIem probability Ob Occurrence of a given symbol, 

in the above formula it is assumed that the each new symbol 

1s independent of the proceeding ones. In the situation where 
the symbols are transmitted over a noisy channel a given symbol 
xX, may be received as Ys. Shannon's measure of equivocation 

or uncertainity at the receiver is to what was actually 


iieahcmitted 1s Gefined as: 


H(x/y) = Py >P(x,, y;) log P(x. /y.) 
For the binary symmetric channel where the jb is a conditional 


probability of an error being made in the channel 


H(x/y) = - (PlogPt(1-B) log (1- Pp) 
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Then the channel capacity 
m= W(x) - H(x/y), 


maximized for H(x). 


In the following discussion the probability of error will 
be used instead of equivocation, the two concepts were closely 
related but the probability of error is more convenient. 

For clearity B and P(e) will be defined here as follows: 

B= P(O/1) = P(1/0) for the channel 


pray = number of wrong decoded words 
total number of words 


note that in the case of ASCII characters where each character 
is represented by 8 binary digits, less than the total number 
of digits representing the ASCII character may be coded into 

a Single word or on the other hand one or more ASCII characters 
plus a fraction of a character might be coded into a word. 

A ‘best code' means one that least probability of error 
for any given channel jp and highest rate R=k/n. The error 
@errection ability of the code can be derived from the 
Varsharmov - Gilbert - Sacks condition 


2e-l1 ae 
2" > er 
i=0 


and closely related to rate R of the code. After definition 
of the code rate R, and word length n_ one can find the 


number of correctible e-tuple errors from Varsharmov - Gilbert - 


op. 





sacks condition. The theoretical value of probability of 
error is given by / Ref. 37: 
= 
2 _ Too neg taal 
p(e) = 1 |=. N. p (1 p) 
1=0 


where Ne is the number of correctible e-tuple errors, where 


e:=0,1,2,.., up to the maximum number of correctible errors 
Peweword. 

The Hamming distance (d) as defined earlier is the minimum 
distance between code words. If d happens to be even and 
the maximum value of e is given by (d-1)/2, this will 
yield a fraction. Then number of maximum e,-tuple errors 


Memeiven by / Ref. 4 _/. 


u(utl1) 
MUMbeGTOr correctible d/2 errors a Z 


total number of 4/2 erros & } 
d 


Vee 





where Uu= 


Reduction in the probability of error, keeping the channel 

constant, results also in a reduction of the code rate. By 
working backward, for any given probability of error and word 
length, (for a given channel 6), from the Varsharmov - Gilbert - 
sacks condition and the theoretical value of probability of 
error equation, one can find the information length and code 
rate. Figure 21 to be described in the conclusion section 


relates Pp » Piro nana etie probability of error. 
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Woe dees es 


Biieece Gitterent code rates vs. different channel P's 
feeeeexamined in this thesis. To get the probability of 
error, approximately 40000 words were mixed with noise for 
each given binary symmetric channel B. For a (15,4) code 
(Rate R = 4/15), two different decoding systems (Minimum 
distance decoder and syndrome method decoder) and two different 
generator polynomials G(x) were used to find the probability 
SeCrror. 

Table Il represents the probability of error vs. channel 

B's of the code (15,4) for two different generator polynomials 
and two different decoding systems. Probability of errors 
for those systems and for different generator polynomials for 
given channel jg's are in the limits of * 1% difference. 
This means that for any given code rate, the minimum distance 
decoder and the syndrome method decoder gives the same prob- 
ability of error. Furthermore using other generator polynomials 
of the same rate does not change the probability of error. 
Figure 18 shows the three dimensional representation of 
the (15,4) code. 

Figure 19 shows the three dimensional representation of 
the (15,8) code using the syndrome method decoder. As one 
sees the shape of the P(e) vs. Pp curve is a S-shaped. As 


Pp increases, P(e) approaches 1.0 as a limit. 
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Figure 20 shows the three dimensional representation of the 
(21,16) code using the syndrome method decoder. The shape of 
the P(e) vs. B curve is also S-shaped, but the steepness of 
the curve is much greater than for the (15,8) P(e) vs. BB 
curve. 

Tables III and IV shows the probability of error versus 


channel ya °"s for the codes (15,8) and (21,16) respectively. 
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Table III. P(e) vs. Channel Beta for the Code (15,8). 
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Table IV. P(e) vs. Channel Beta for the code 
(7a Fila). 
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VI. DISCUSSION AND CONCLUSIONS 


Two different type of decoder (syndrome method and 
minimum distance decoder) discussed in this thesis give 
the same probability of error for the same channel iB: Ione 
the irreducible polynomial. code the minimum distance decoder 
is faster than the syndrome method decoder. For the (15,4) 
code the number of syndromes are S(x) = 25-4 = gil = 2048 
with the same number of correctors (error patterns). After 
multiplication of the received word by the parity check matrix, 
the result (syndrome Is}. will be checked if it is equal 
one of the 2048 syndromes previously listed in the computer 
Memory in order to find the corrector. But for the 
Same irreducible polynomial code (15,4) there is only one 
maximum cycle set; therefore the received word will be checked 
jevit is in distance d/2 or less to these 15 words, and so is 
much shorter in time than the syndrome method decoder. On 
the other hand, for the reducible polynomial code (21,16), 
there are 221-16 = 29 = 32 syndromes and the same number of 
correctors (error patterns). After multiplication of the 
received word by the parity check matrix H(x), the result 
(syndrome (Sl. ae will be checked if it is equal to one of 
the 32 syndromes previously listed in the computer memory, to 
find the corrector. But for the same reducible polynomial 


there are 216 a1 = 3121 maximum cycles length of 21 (excluding 


zero trivial cycle). Therefore there are 3121 x 21 = 65536 
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words to be checked if the mecca ig tin @Y/2 Clifsansiove 
apart from those words, which is much longer in time than 
the syndrome method decoder. As a result one can predict 
for any given code (n,k) from the number of syndromes and 
number of maximum cycles for the minimum distance decoder 
which method is shorter in time. 

For any given code (n,k), sometimes there is more than 
one generator polynomials, then the probability of error 
Pesults do not depend upon the polynomial being used for 
any specific word length and information length (See tabulated 
results for (15,4) code in Table II). 

The shape of the P(e) vs. channel p curve for any given 
@ece rate 1S an S-shaped curve: the greater the code rate 
the steeper the S-shaped curve. Figure 21 combines the cal- 
eulated probability of errors for the 3 different codes, were 
investigated. For any given channel 8 and permissible pro- 
Dabllity of error one can obtain the maximum code rate 


from the given figure above. 
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APPENDIX A 


Program flow: 

1. Noise program; First generates random numbers and put 
a marker "1" due to random number in the random number field 
between memory addresses 57000 - 77776. Second combines the 
markers in the random number field according to word length 
and puts the resulted noise between memory addresses 32000- 
P2100. Noise program starts at address 10000, end of the 


proeram at the address 10212. 


2. Input program; Takes the input messages and puts 
addresses between 51000-52000 in sequential order. Location 
(50100) counts the number of input messages. Input program 


starts at address 20000, end of the program at address 20122. 


bee G&ncoder; 

A. Encoder for the (15,4) code; Takes the input 
messages between addresses 51000-52000, encodes and puts 
between addresses 52000-54000. Generator matrix is in addresses 
between 50200-50206, location (50140) is used for ASL, (50142) 
is used for encoding operations. Program starts at address 
20124, end of the program is at 20240. 

B. Encoder for the (15,8) code; Takes the input 
messages between addresses 51000-52000, encodes and puts 
between addresses 52000-54000. Generator matrix is in addresses 


petween 20610-20626, location (50104) is used for encoding, 
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e102) is used for ASTI, operations. Program starts at 
address 20124, end of the program is at 20204. 

4. Noise mixing sequence; Adds the noise between addresses 
32000-32400 to the encoded messages between addresses 52000- 
54000 (in modulo 2). Carriage return has the noise immunity. 
Noise mixing sequence for the code (15,4) is between 202/2- 
20332, for the code (15,8) is between 20206-20250. 

5. Decoder; 

A. Syndrome method decoder for the code (15,4); Takes. 
the transmitted message mixed with noise from the addresses 
between 52000-54000, decodes, corrects the errors if they 
are correcible and puts the addresses between 56000-57000. 
Parity check matrix H(X) is between addresses 50210-50244, 
syndrome S(X) is between 50246-50304, corrector (error pattern) 
Z(X) is between 50306-50340. 

B. Minimum distance decoder for the code (15,4); 

Takes the transmitted message mixed with noise from the 
addresses between 52000-54000, decodes, corrects the errors 

if they are correctible and puts the addresses between 56000- 
57000. Register C described in Figure 9 is in address (50104). 

C. Syndrome method decoder for the code (15,8); 

Takes the transmitted message mixed with noise from the 
addresses between 52000-54000, decodes, corrects the errors 

if they are correctible and puts the addresses between 56000- 
57000. Parity check matrix H(X) is in addresses between 20630- 
20664, corrector (error pattern) Z(X) is in addresses between 


20666-20774, syndrome S(X) is in addresses between 20776-21104. 
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6. Output program; Takes the decoded message from 
addresses 56000-57000 and writes it out, program is in address- 
es between 20704-21000 for the code (15,4) minimum distance 
decoder, 21506-21604 for the code (15,4) syndrome Tee 
decoder, 20406-20502 for the code (15,8) syndrome method 


decoder. 
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NOISE FROGRAM 
RANDOR NUNEBER ADDRESS 1803 


-—- & s——- — 


FACTOR. 


Wl 

610006 
Q10082 
G1Hh64 
G1HAGE 
610010 
Ss eS 
G16014 
B1H616 
HiGgss 


' 6166282 


aioaed 
@1aaze 
QLH0256 

AL106s8¢ 
@100=4 
ALOasé 
G1i6G46 
A1Ga4e 
Hi ohd 4 
ALaade 
Gi Gash 
A1aase? 
G@1O054 
ALag56 
A1GG66 
G40662 
O1boa6gd4 
G10066 
GiG6°4 
a1007e2 
G1ibtrd 
G@iaa7e 
G104604 
G1162 
610104 
O10466 
H10116 
G@16@112 
a48@144 
G416146 
@i81260 
H18H422 
Q104e4 
G1G126 
* 


fa12°0b 
fHS20Uh 
maa f OL 
fEdL OEE 
PHHEBSH 
POP? ridge 
f7OGHS4d GE 
YALZ7 OE 
7S ater ve 
reed 
oc 
oe oS 
POLLEE? 
PHOS 
faLeE rad 
parr sh 
adie, id 
fHLO044 
PALZES/ 
parr SOE 
fa1ider 
Y/OBG026 
fHL2764 
eer, 516 
gute WE 
fOGAas& 
fO1262¢4 
faLeF%14 
fHBRb4O4 
fHiddde 
fHE?7 41 
fOOHH4S 
mei, <r 
15) 3 a eae 
fHbaG06 
redidid 
fB41644 
reasudd 
aude rv ii 
mere CN 
(G05? 24 
riderid 
fEHObO4EL 


APPENDIX B 


—_ 


——_. 


URES Sie Pies 


— —— —e— = = 


co ectiGhoebhe cated! MiG 


HAS THE INDEXING 


fede 


Wy 


GiGix6B *Htob14 


G61LHise 


POLE? 2 


101354 /GhO64L 


O14 <6 
10146 
H1iide 
Himidd 
H10146 
AL&éics& 
Giaiae 
ALaiad 
ALG156 
ALHLe& 
G1i8i6e 
Q40464 
G10166 
Abit 
Gihire 
O4Gi74 
A1O17é 
GiGeoe 
a@1aecae 
ALGehd 
a1acae 
Q16216 
AL1Gec42¢ 
»: 


PHERHH4 


PHOHOF SE 
fHOSBSE 
fHLE POO 
POS 7604 
fPHLeE Fat 
fESe2hOh 
Paterbe 
fe SSM B Ue Be 
Puieg Ws 
fHERESE 
fERESeEH 
rOOeadd 4 
iG 7 ee 
PaaS? 
POAZP AR 
PEGHHUS 


pee ee 4 
ele tats 
fOOOOOE 








APPENDIX C 


INPUT FROGRAM 
fer? HESSAGES 


The Baaeec ECE 


Abeer eect niCnais: THe NEEE fr Cle 


@ defines the end of the program 


yd 
B2bH00 
B6¢hRae 
avouad 
AcGORE 
@cG16 
aeagie 
a@ehoi 4 
GeGa1e 
Gea 
GO2fhHS? 
aehbed 
G62 a. 
Acad s 
oo: 
aes 4 
GHOSE 
Gea it 
Qecuade 
O&ehhdd 
O2HAdE 
GlOaS 6 
G@2hOSe 
G&ecaasd 
GHehUSE 
ached 
H2hHHE?Y 
G2ohed 
BSOOEE 
aehar & 
acvGure 
acaa?’d 
Heoa? 6 
G2uLae 
GBLaLas 
a@euilad 
G20106 
Ge114 
aeatic 
G2biid 
Q?¢b116 
@2012h 
BeG122 
S 


PRAD? Gt et 
P7Ho thee 
PHMIHA? 
mitag 5° 
fines e ot 
GAAS 
vale des et 
Polite ees e 
Clee? il 
PAROS AA 
i ae as 
fPHHASAS 
poatlccy Sr 
(leat © + 
fae ct 
Fela SF 

fie ae & 
(eed = i 
P0215 
POLE AL 
C tiiiot ¢ G6 
Gee bl 1 
f/AMAALS 
Par sr 
fir robe 
CAGES? S 
Pane Ss 
PHRECEA 
ab iera te & 
Farge La? 
fa 1k Sia) Fameres 
fir raed 
PLGaSrS 
lulls Beara 
PHHELSY 
7 ly far cE: 
POHAP SE 
Oe 7 
Pa5S0L Ae 
P7HESHEE 
PHATAE? 
fHHOR EE 


(LZ 





APPENDIX D 


ENCODER FOR THE COGE (15,4) 
ROWS GF GENERATOR MATRIX GCX> IN ADDRESSES BETWEEN 
SHZHG -SAZHE 


b 
AShied 
@26126 
Sa 2 eS 
@ebLee 
Heh4is4 
me 1 = E 
G@ceG146 
@ecbhide 
A¢eh4i4d4 
G@2H146 
oe 
HHS 
Oe 454 
HSHLAE 
HCHLEE 
AeOL6e 
aceb164 
G@ee1e6 
A@ec1 re 
B20147e2 
Qehirvd 
HfL 76 
GQ@eGeh4 
A2G2He 
Q@ehecbhd 
GLOLHE 
ach eta 
Q@¢eheie 
aecheid 
aes 
@202¢24 
Q@eheee 
aeaded 
Q@L2H226 
B2HESb 
ASH2Se 
B2b2x4 
a 


(ALE 7 aG 
POSTAGE 
PAOHSdH 
fHHREAH 
Pus Be 
moot Lins 
Pe es 
fOHI0148 
eee Ne 
CHbE0bs 
Paterad 
rae ES RAR SESE 
f@Le POS 
PbS eo 
POSG142 
Gl Teens 4 
AeMSS Rg 
fOuG1 4h 
f7ibS00e 

ral ale 
fO201de 
PHEGS¢E 
fOrF% dla 
POPs ese 

A oka (Aide 
Pa5e¢00R 
(ObS¢sFr 
P2014 
“AES ese 
ie (ali) a. 
far r ioe © 
a ae 
POLZP? SE? 
f7O52004 
feet 
7aHGebEE 





ENCOOCER FOR 


Wl 

620124 
620126 
G2H124 
G20132 
H201=<4 
620126 
626146 
H26142 
620144 
O2H146 
620156 
G20152 
620154 
ACHIS6 
Q@20164 
O2O16¢ 
GO¢H164 
GQ2h1G66 
G20174 
mee sie 
azh1ir74 
Q@20176 
A2a2oG 
G2be2he 
Aco a4 
#: 


fO127040 
“AS10040 
“HL2°7 aL 
POS2HHO 
fHLs 7°02 
fPASH1a04 
fag es a 3 
f7ASHLas 
PALE PAS 
POLZHEL4 
PHLe2 rf b4 
f7OHORAITA 
FHRSAS? 
PA5S0104 
pee 2 
pAb (Sha os Bare 
7 {al S58) st Sea 
SAB) Se BIB ee 
PHP AGES 
Pa5ht ad 
POP e4he? 
Pal dene: 

PARAL aAd 
fOrvrfece 


POOHEdH 


als 


BUG NERS | CC nGate 2, 


7 





NOISE 


Wl 

628242 
a2B244 
G@2G246 
20254 
G&ee2¢52 


Beheaded | 


ache ss 
AcOCEA 
B2O2%6¢2 
AZCAZEd 
Be eée sé 
ASH? E 
ALOE Pe 
avhe rd 
Hee 7 E 
G26206 
Q@2uste 
Geb sd 
AZO She 
ecu siG 
Geb sie 
actiisi4 
eH SiG 
Ges eb 
G20 see 
a2used 
G2 <2 6 
G20s50 
a¢eb<se 
a: 


mm 
al 
SJ cess 
AL 
MRD 


A ht 


7HOLEGS 
CHLCHS? 
Zee a eoee as UI 
Ze Seta. Gt 
1a ease 
faoHdid 
POOF 44 
fe Aa 
mores 1 1 
goes Le 
ulin ct Lc 
CHRHHd HE 
“HOSP 4h 
PAHS 4 ot 
7O1104s 
fH/?d¢stt 
eee dc Ul 
(HP PES4 
f7ORHOEE 


APPENDIX E 


MIXING SEQUENCE FOR 


75 


THE CQOOE (15, 4) 





NOISE 


bd 

620206 
626214 
620212 
B62H214 
626216 
B2022U 
620222 
B2H224 
Q20226 
B202=26 
Men 2s 
a2H2S4 
ALCUCEE 
@2ue4du 
GBeHhe42 
Aoneda 
Beuzdsé 
A2h256 
%: 


f/OHOb244 
PHEHEIG 
faeaneda 
f7Hbued 
fH Pas 
fie eA 
ities, GL 
7HZ2SH00 
Vee Sao de 
7HS0Lb4 
715) SS ara 


Peel oee oe 


7Ouldhe - 


fHLELaS 
pag + > 1H 
(Bu oy 2 U 
POPP Eo 


7Ubded Go 


(ie Gece CUPNGERPURe THE COKE. <¢1S, &> 
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SYHOROME 


W 

ALCOLZ4 
Q2635<6 
Q26346 
B2Gs4e2 
G2bz44 
G2B246 
Geusag 
@2HRS2 
Qeasod 
Hc she 
aeB 266 
G@eaxeée 
GeUsed 
ASASEE 
AcaHZ76 
Ges 7 2 
G@eas?d 
Ges 7 
ASH4G EE 
Q264G2 
B2Hdh4 
Q2b46e 
Geh4i1t 
Geud4sc 
@ebdid 
GCUdLE 
H2Od26 
H2bdee 
G@ehded 
G@28426 
G204= 6 
G204x¢ 
Hebd x4 
Ged x6 
Geh44e 
G2Gdde 
GfSh4dd 
Be2Hdde 
G@2G454 
G2645¢ 
a€eG4d54 
Q¢Ud56 
G@2G464 
G26462 
H2R4E64 
Py 


fee 
PEE AE 
7HhBSdA 
pa oe 
7HSEaLOE 
f/BSHLES 
(BS a cere 
PHRHEGE 
f7OS0104 
“OLS "He 
ag 3) 30505 eras 
Pulte; hs 
CHALE 
fOHSHsF? 
fH20.¢e 
PA SP 
fASHL4G 
7OLesba 
fHOER8EF 
f7HS0L40 
7 Et 
cUPdds? 
fPOS5Hide 
po ee ae 
Piveweee = 47 
P7ERHAOE 
f7H50ide 
7401002 
AeGut <¢ 
fe Le Bee 
(G2 
POS024E 
“7O5atde 
f7HOLEbe 
fPHEOLS? 
PH2teEr4 
eles 
PHO E048 
Poa ot 
Cele SF 
PORHRoE 
poietbancted: auc 
me S76 
fHS0158 


METHOD 


APPENDIX F 


CECODER FOR THE CODE 


Vi 


LH 
B2H466 
Hebd,’ 3 
G24? 
ared?4 
620476 
ACHE EH 
O¢eohe 
AHS ad 
Q2Oabs 
620514 
a@¢vhsic 
aehaid 
G@eaniég 
AebSeh 
AeCboRSS?Y 
A252 
G@euace 
SP aS ss 
eas 
eer 
GeUSS6 
Gehadh 
Gehide 
a2add4 
Heh54de 
Q@eho5# 
G¢G5a2 
HeHS54 
A2OI56 
ese & 
HCH? 
Qechaed 
HOO € 
tent 
G205?" 
Ae ne 
He26576 
G20604 
Q2eG6he2 
G2O6h4 
G&2O606 
GO2H61G8 
A2HE12 
G2h641 4 
: 


Cia, 4) 


pie we 
/HAGAL S 
“Ler as 
a seat 
P7OlePr bd 
7HSHSH6 
POLE Se 
POHHOAALE 
“/G50194 
poaos¢ Go 
PaoHide 
f7EEL60e 
Canad se 
/OELE04 
aS Se 
fPOSHL52 
o ilsy Sis Gay = 
fae 4a, 
mead toe 
AA eae 8 
7W? =e 
75845 
Mee? a? 
aan ae 
P7HIGi4de 
PHHLHES 
PHHRLS? 
foes 
FAAS a G leg Pee ae 
mia S 
Phe oe See 
PHSbLaA4 
7@ASS50 
fAH6cHL 
POP rsd 
PAHSSSe 
P7b6204rH 
/HG1406 
fHeG240 
POHESS? 
7H5H156 
PHHE6LSe 
eased ae 
f/H00/e? 





b 
Q@20616 
G2HE2b 
62cb622 
G20624 
E2HE?E 
ALHESE 
a20682 
HEHES4 
GQ2OE%6 
aehe4 & 
ached? 
G&ehedd 
G2HE4dE 
@cOGS 8 
ee 
HehHAS 
@ene S ' 
GCHEE & 
H2hbb?2 
G@20664 
APCHEE E 
ACHE SH 
ASHE? 2 
Hehe?’ 4 
@ecoeré 
Ae’ oe 
G2Gra2 
Geurad 
Gea rae 
GeO’ u 
A&cGrLe 
Gecavid 
GLb Le 
Gece 
G20’ ¢e ce 
Gehred 
Met’ 26 
Gee? sh 
G2GrPs2 
Geuesd 
Gc: “ft; <6 
Aza’ 4h 
Gearde2 
Gears 
a@curdé 
GeaPrsad 
Bee IR? oe 
B26"? 54 
B20H756 
G20°Eb 
GeQ’?62 


G26764- 


*K 


“7Obo24h 
CHAALE? 
7OuUO008 
oe ¢ Si 
“OBACHOHA 
f/AeHd oa 
Ze fee 
“7OH4H60 
“O20426 
“ULE = 7k 
“7HGhGe 
PHEHdI PH 
fhlersd 
PHSECEE 
“Bebs4 rad 
ee 
AIS) DU EAs 
PAHSCHASIAA 
(7S 
POMERAT? 
rPaCHSH4 
Mise 1 Se 
7ERHIES 
7 Sn ase 5 
TA cy Sar 
PeRRhSed 
Fagus 
ade ls ¢ 
COachddé 
pe PS 6 
7HELESE 
/HCHH SEA 
mee ae 
7/aGedok 
PHCH4 a6 
PaLe, Sr 
POMGH14 
fHead’G 
POLE? sé 
faster 
fOaehd rd 
Bo eS 
RAG eee. 
P/O265hH4 
Ae eae 
POHAAHE 
7H20504 
Bee et St 
PBHHO26 
PHeNE ee 
CHEELS? 
f/a28446 
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NW 
B2H766 
G20? ?°G 
G20? Fa 
HOP? 4 
G207 76 
QeLaag 
G21662 
B21004 
G21 006 
GQ21016 
AZLTALS 
Aei_oaid 
He21h16 
Qei acon 
a¢iaee 
ASLied 
APLASE 
5 Gay i OB S| 
He ia =e 
G@eiaosd 
ASCLASE 
O21 4 & 
HeLade 
Ge1add 
Get O4de 
OeiL soe 
S21052 
Gei Gad 
Say en 
G2LG64& 
ACLHE? 
Qed he 4 
G27 O66 
ASL ae a 
ACES? 
a2iturd 
G210°6 
Q2414166 
A2ZI1T6 
GeLi&4d 
G211606 
A2441140 
He14 V2 
G21114 
G21116 
G21i2ca 
Q211e2 
621124 
re 


Cav ar ce 
“7OHAOdOE 
f7HZH4548 
peeiee (37 
CHOSHEG 
PALAdSE 
Pe Sg 
f7O006L4 
“He2OHd4 PE 
COUGas re 
PF OOHRAZ dg 
fHCHbES 
PHOHRALZS? 
PHA AE 
(Le oe 
PORALa& 
CHSH4S& 
Uae 1 
fPHOdd Ha 
PHEAGEE 


POLE7 =? 


Oe ‘ad? A 
C0 oe ap 
“SAREE 
(O2h6ee 
7AAALE 
“be BASE 
pce a 
P7OHORH44E 
PHCHASA 
(eae oar 
“HO4FECOO 
fHEOdF5E 
FOOLER Se 
7HROEAS 
CHCHd PG 
PARZPE?P 
“HEROS 4 
“7AHeh6ee 
“OHS? 
fHecH44dsG 
PaaS 
“7HOOHSE 
“PHCHd4SE 
Cae Gar 
“7OH4404 
P7HZH456 





bd 

a@21406 
B2140¢2 
O¢cidud 
621466 
G214186 
G@21idie 
Acidid 
0821416 
G21424 
621422 
6¢e1idz4 
Q@24426 
O21434 
Beds? 
G@21ids4 
HCV 4356 
aeidda 
Beidde 
Aeciddd 
ACL44d6 
Qe¢idsG 
Aecidse 
G@21idsd 
Q@21456 

eidod 
Bede 
Geided 
B2ideé 
GQ214°6 
A2idr2 
aeldrd 
Gerd ere 
G24 506 
Q2iage 
@eiagd 
#: 


oS aah Es Bias 
f“ASHLad 
f7@H1405 
mots Se 
7HSaSSG 
fHHSP SH 
POOnie - 
f7ECHSEE 
(LBESES 
7G eis 
coe eS Hs 
(LAGS 
(bWLerbe 
CHORE 
mae = aS 
SIIB eas ARE Te 
pie et 4 
fHOAALS 
peta «a 
os cS f 
Pashsak 
PHAEHEO 
FOURS Ss 
“HSA 45 

fPOEGHeL4H 
PAaRHRS4H 
reno Se ae 
pale So 
ZnS = 
f/HSOALA? 
PHALCSES 
Pade Se 
7HOE6EHHE 
PH21i4dad 
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MIMIMNUM OISTANCE DECOCER FOR THE CODE (145, 4) 


bd 
620456 
G2H466 
B2046e2 
H2Hde4 
ACOdES 
426476 
A264?2 
o2hd?4 
aehd76 
A205 060 
O2054e 
ea 4 
B2aSG6 
GQ¢Ohi& 
B205412 
Aeh544 
Q@20516 
@ense8 
Hebe? 
B2A5e¢4 
ACHSAE 
AOS & 
a@fHoise 
AS his 4 
B245 26 
Aedid a 
GHeeode 
G2h544 
GehS54e 
a2G55 0 
Q205582 
@2655 
GQ2¢G556 
ached 
A256 
aeGa64 
G20H566 
aecoaru 
G@205Pre2 
G205?4 
G2H576 
G@20666 
Q@26602 
HeH6B4 
H2H606 
&2Gé14 
acaéie 
G2HE14 
G2H616 
GebEcH 


“900244 
PHRAaSd A 
fPHb024¢h 
“7OL?¢ 700 
PHS?¢HHE 
Paes S 6 
P7HSH1G4 
fHI01Lbe 
moe sa Sf 
Fal aul Att 
f“HSALaS 
fais ¢ 1. 
f7aoartad 
PELE Pr 8s 
PAS4hOG 
file, Ad 
aed 
PUSOLLE 
PALLEAAS 
fG@r°4¢145 
Paiste cag ic 
PAURAALS 
fades aS 
O05 a 
cet 1 C. 
fOrrechd 
YEeedrsy 
fPaogaunad 
Papa e\id ty 
P/HOSHL4 
(OBE SAL 
Ps 4 2 
POP rdel 
c "AAA dM a? 
Paeeedl 
gee 
eG 2S 
POOa4 Os 
fOL10L1!E% 
f7EHS°24 
fGadas 
pote te & 
Aas 
r, aad 
es 
fOUEEEL 
7650142 
7HBSSS6 
f7a00?¢4¢o 
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hd 

G2h6¢e2 
G&euoe?e4 
AeHeeeé 
G2GE624 
OeGES2 
GedEes¢ 
G2U656 
ached h 
H28E4d? 
achedd 
ACHE AE 
H¢2H654 
ae¢heae 
G&eGead 
HSGESE 
GZGeEsG 
Gch Eec 
Gee &.4 
ASHEEE 
ASAE? a 
HSGe?e 
Geh6r4 
aehe rt 
Geo rag 
GQeG/’?e 
>: 


faRHS4o 
f“OGGe4q 
“7HOROSE 44H 
f7Eo0e¢4G 
PALS7?Ue 
fO28L 60 
fO41e°r04 
7O54 G00 
f7HLeF OL 
7ASE6HOh 
PEaLE PAS 
/OhEEHe 
“OARShad 
f7ELE84d6 
PO12046 
atin el 
f7EHOR0H4 
PFHOESLE 
PBaELoad 
fA FSEAS 
radar 2G 
fr robe 
SBOE CSP sl 
Poe cee 
PERO 004 





SYNDROME 


bd 

GB20?¢5¢ 
625254 
G62H256 
GB226U 
B2b?2b2 
avuzead 
B2b266 
62GerG 
Behe7e 
Geter 4d 
Beb276 
ACH <hh 
aHebshe 
Geb xX4 
GCOS HE 
G2Si6 
ACOs e 
Aeneid 
ACHELE 
ACOSeH 
aAe2ase? 
aecosed 
G@e2asceé 
HLURB 
Heh sse 
Oe s x4 
AOS SE 
H@¢H< 4G 
Gebsde 
Aeuosdd 
aecGas4dé 
@eassh 
eas a2 
AeCHsad 
G2US96 
G2COSE4 
Q@2HS62 
aeh<64 
ACOs 
G620374 
Gebxs’r2 
Geos? 4 
Beus?’6 
Q@eadGG 
G@e0udac 
GO204h4 
x” 


7612704 
f7HAZCHHAO 
move? AL 
f7HSIEEOG 
es 7 We: 
7O001 00 
maths 7 
fHPAALHES 
wae 7H Ss 
7ALHESE 
PHLer ad 
PHAEOL? 
BONS s ¢ 
fPESHALAd 
VALEZAS 

fPHHBSE? 
_ age 

PUPASEP 
fPaeaetad 
POer7d¢h? 

f/ARaP Ss? 
PASEL a4 

f7OHLdeL 
Pa dey als 
PULZHP PE 
“Ler a4 
COCHEEGE 
4S os ee oS 
AORHod 4 
PVaOSHLAE 
puss eS 
fUoALa4 
PHHLIGS 
fPHHaP Sd 
Pacis S 
faa He 
cHGe Sop 
PHHHdE2 
Pb6L11405 
faP4R16 
fCHORS16 
aS aa 8 
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APPENDIX H 
The simple run: 
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Beodieee Pe THE CODE (15,4) CHANNEL NOISE 
fee i hG OP ae Tk 2 THIS IS LOW LEVEL 
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Decoding with minimum distance decoder ; 


morte PMR ThE CONE <is, 4. CHANNEL NOITE 
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Without decoding =; Without error correction 
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